Attorney Docket No. 042390.P1 1381 Patent 



United States Patent Application 

FOR 

Apparatus and method for packet Ingress Interrupt Moderation 



Inventor 
Patrick L. Connor 



Prepared by: 

Blakely, Sokoloff, Taylor & Zafman, LLP 
12400 Wilshire Blvd. 
Seventh Floor 
Los Angeles, CA 90025-1030 

(503) 684-6200 



Express Mail No. EL625195785US 



^feney Docket No. 042390.P1 1381 
Express Mail No. EL625195785US 

Apparatus and method for Packet Ingress Interrupt Moderation 

FIELD OF THE INVENTION 
[0001] The invention relates generally to computer networking and, more 
particularly, to an apparatus and method for moderating interrupts asserted upon receipt 
of packets at a network interface. 

BACKGROUND OF THE INVENTION 
[0002] A network interface may receive hundreds - and, in some instances, 
thousands - of packets per second, but such a network interface may also receive packets 
at a rate of only a few packets per second. The network interface asserts an interrupt to 
signal the receipt of these packets, the interrupt indicating receipt of a packet (or packets) 
to a network driver, as well as to the protocol stack and applications that need the packet 
data. This interrupt, which indicates receipt of one or more packets at a network 
interface, is commonly referred to as a "packet ingress" interrupt. In many applications, 
such as, for example, in highly pipelined processors, interrupts are inefficient, and a high 
rate of interrupt generation can drastically increase the load on a CPU (central processing 
unit) or other processing device. 

[0003] During periods of high packet ingress, in which a corresponding large number 
of interrupts are generated, the CPU is highly utilized for interrupt processing. The CPU 
is, therefore, bandwidth limited and may be unable to service all received packets and, 
accordingly, the processing resources available to other system components - such as the 
protocol stack, operating system, and application programs - are reduced. Further, a high 
rate of packet ingress (and the corresponding high rate of interrupt generation) can lead to 
delays in sending acknowledgements and may cause subsequently received packets to be 
lost. Thus, a high rate of interrupt generation due to packet ingress can reduce overall 
throughput and system reliability. 

[0004] To alleviate the problems associated with high packet ingress rates, a network 
interface may moderate the assertion of interrupts. Generally, interrupt moderation 
enables a single interrupt to signal receipt of multiple packets, thereby reducing the 
number of interrupts generated during high traffic periods. Signaling receipt of multiple 
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packets with one interrupt may be especially useful, if not essential, for high-speed 
applications. However, during periods of low packet ingress, interrupt moderation can 
itself add latency and reduce throughput, as a packet may have to "wait" for additional 
packets to be received before an interrupt signaling arrival of that packet (as well as the 
additional packets) is asserted. 

[0005] One conventional method of interrupt moderation utilizes a timer. The timer 
is set to a pre-determined threshold and is started upon receipt of a packet (i.e., when an 
interrupt would normally be asserted). Subsequent events - e.g., receipt of an additional 
packet - do not affect or restart the timer, and the timer continues to count down (or 
count up). Upon expiration of the timer (i.e., upon passage of a timer period equal to the 
pre-determined threshold), an interrupt is asserted to indicate the receipt of the initial 
packet (i.e., the packet that triggered the timer) as well as all subsequent packets received 
prior to expiration of the timer. Thus, the timer enables a plurality of events - e.g., 
arrival of a packet - to occur before asserting the interrupt, and a single interrupt can 
indicate receipt of multiple packets. However, although relatively simple to implement, 
the use of a timer exhibits a number of undesirable characteristics. 
[0006] One drawback of the timer method is that assertion of an interrupt is delayed 
for each received packet, irrespective of the rate of packet ingress. During periods of 
heavy traffic, the timer method functions well, as a single interrupt will, in most 
instances, indicate the receipt of multiple packets. However, in practice, network traffic 
is "bursty" in nature and prolonged periods of sustained heavy traffic (or sustained low 
traffic) are atypical. Thus, a network interface implementing the timer would not receive 
a sustained high rate of packets for which the timer method is best suited. When a single 
packet (or a small number of packets) is received during a period of low traffic, assertion 
of an interrupt signaling receipt of that packet will be delayed until the timer expires, 
even though no other subsequent packets (or only a few subsequent packets) have been 
received. 

[0007] If the timer is set to a high threshold, the timer will add latency and reduce 
throughput during periods of low packet ingress. Setting the timer's threshold to low, 
however, is also problematic, as interrupts will not be adequately moderated, which can 
also reduce throughput. To strike a balance between a high timer threshold and a low 
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timer threshold, both of which can add latency to packet processing, the timer is usually 
set to a threshold representing a time necessary for receipt of one to two packets, which 
allows two to three packets to be received per interrupt without excessive delay for any 
one packet. 

[0008] To optimize the timer method for a broader range of packet ingress rates, 
algorithms have been developed to dynamically adjust the timer threshold based on 
traffic loads. These algorithms can only sample past data and, depending on the sample 
rate of such an algorithm, when network traffic changes abruptly, thousands of packets 
may be received before the algorithm can adapt the timer threshold to the "new" 
environment. As noted above, network traffic tends to be bursty in nature and, 
accordingly, these dynamic algorithms are, in practice, not optimized for most network 
environments. 

[0009] Other methods for moderating the generation of packet ingress interrupts at a 
network interface are known in the art. However, these methods - some of which require 
a microprocessor, a microcontroller, or a complex, dedicated state machine for effective 
implementation - are complex and expensive to implement. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0010] FIG. 1 is a schematic diagram illustrating one embodiment of a system for 
implementing a method of packet ingress interrupt moderation. 

[0011] FIG. 2 is a schematic diagram illustrating another embodiment of a system for 

implementing a method of packet ingress interrupt moderation. 

[0012] FIG. 3 is a schematic diagram illustrating a further embodiment of a system 

for implementing a method of packet ingress interrupt moderation. 

[0013] FIG. 4 is a flow chart illustrating one embodiment of a method of packet 

ingress interrupt moderation. 

[0014] FIG. 5 is a timing diagram illustrating in more detail the method of packet 
ingress interrupt moderation shown in FIG. 4. 

[0015] FIG. 6 is another timing diagram illustrating in more detail the method of 
packet ingress interrupt moderation shown in FIG. 4. 
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[0016] FIG. 7 is a flow chart illustrating another embodiment of a method of packet 
ingress interrupt moderation. 

[0017] FIG. 8 is a flow chart illustrating a further embodiment of a method of packet 
ingress interrupt moderation. 

[0018] FIG. 9 is a timing diagram illustrating in more detail the method of packet 
ingress interrupt moderation shown in FIG. 8. 



DETAILED DESCRIPTION OF THE INVENTION 
[0019] Referring to FIG. 1 5 a system 1 includes a bus 10 having a processor 20 
coupled therewith. The processor 20 may comprise any microprocessor, ASIC 
(application specific integrated circuit), or other suitable processing device. A read-only 
memory (ROM) 30, or other equivalent memory, may also be coupled with the bus 10, 
and the ROM 30 may have a system BIOS (basis input/output system) 92 resident 
thereon. In addition, one or more input devices 40, as well as one or more output devices 
45, may be coupled with the bus 10. Common input devices 40 include keyboards, 
pointing devices such as a mouse, and scanners or other data entry devices, while typical 
output devices 45 include video monitors, printers, and audio output devices (e.g., a 
sound card and/or speakers). 

[0020] A main memory 50, or other equivalent memory, is coupled with the bus 10, 
the main memory 50 comprising, for example, dynamic random access memory 
(DRAM). An operating system (O/S) 94 and one or more application programs 96 may 
be resident in the main memory 50 during operation of the system 1 . One or more 
drivers, such as a network driver 98, may also be resident in main memory 50. The 
operating system 94, application programs 96, and network driver 98 may be stored in a 
storage device 60, the storage device 60 comprising, for example, a hard disk drive or 
other suitable non-volatile memory. The storage device 60 may be coupled with the bus 
10 via a Small Computer System Interface (SCSI) bus 12 (see, e.g., the SCSI-3 family of 
specifications). Further, the system 1 may include one or more removable memory 
devices. For example, a CD-ROM drive 70 may be coupled with the bus 10 via SCSI bus 
12, and a floppy disk drive 75 may also be coupled with the bus 10. 
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[0021] The system 1 is coupled with a network 5 by a network interface 80. The 
network interface 80 may be coupled with any type of network 5 - including the Internet, 
a wide area network (WAN), a metropolitan area network (MAN), or a local area 
network (LAN) - exhibiting any suitable network architecture. The network interface 80 
may be integrated directly into the system 1 (e.g., provided by instructions and/or 
circuitry disposed on a motherboard). Alternatively, the network interface 80 may 
comprise a separately attached peripheral card, such as a network interface card (NIC). 
For example, the network interface 80 may comprise a PCMCIA (Personal Computer 
Memory Card International Association) compatible peripheral card - see, e.g., PC Card 
Standard, March 1997 Release - or a PCI (Peripheral Component Interconnect) 
compatible peripheral card - see, e.g., PCI Local Bus Specification, Revision 2.2. 
Further, the network interface 80 may communicate with the network 5 via any suitable 
media, including copper wire or other cabling, fiber optic cable, or a wireless media. 
[0022] The network interface 80 provides an interface between the network 5 and the 
system 1 . For example, the network interface 80 may receive a packet (or packets) of 
data from the network 5 and indicate receipt - by asserting an interrupt - of the packet(s) 
to the network driver 98. Further, upon processing of the interrupt by the network driver 
98, receipt of the packet(s) may be indicated to the system component (e.g., operating 
system 94 or an application program 96) to which the packet is directed (e.g., as 
identified by a socket address). The network interface 80 may also send packets from the 
system 1 out onto the network 5. 

[0023] In one embodiment, the network interface 80 includes a controller 82, a packet 
timer 84, and an absolute timer 86 (see FIG. 1). In another embodiment, in lieu of an 
absolute timer 86, the network interface includes an absolute counter. For example, as 
shown in FIG. 2, the network interface 80 may include an absolute packet counter 88a or, 
as illustrated in FIG. 3, the network interface 80 may include an absolute byte counter 
88b. Each of the controller 82, packet timer 84, absolute timer 86, absolute packet 
counter 88a, and absolute byte counter 88b may be implemented in hardware (e.g., 
packaged integrated circuits or other circuitry), software, firmware (i.e., instructions 
stored in a ROM or other programmable memory), or any suitable combination thereof. 
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[0024] When any one of the packet timer 84 and absolute timer 86 (or absolute 
packet counter 88a or absolute byte counter 88b) expires, as will be explained below, the 
controller 82 will assert an interrupt to indicate receipt of a packet or packets. Generally, 
this interrupt is received by the network driver 98, which is executing on processor 20, 
and the network driver 98 includes an interrupt service routine (ISR) that will process the 
interrupt. Upon receipt and handling of the interrupt, receipt of the packet(s) may be 
indicated to the operating system, protocol stack, applications programs, or other system 
component that requires the data. 

[0025] During operation of system 1, multiple interrupts may be asserted by the 
network interface 80 to indicate receipt of a plurality of packets. Each of these interrupts 
may actually comprise the same interrupt (i.e., an interrupt asserted at the same pin or 
status bit), and it is assumed herein - for clarity and ease of understanding - that the 
interrupt asserted upon receipt of any packet is asserted at the same pin. This interrupt 
will be referred to herein as the "packet ingress" interrupt. However, it should be 
understood that, when multiple interrupts are generated in response to receipt of a 
plurality of packets, these interrupts may be asserted at two or more pins and, further, that 
these interrupts may be viewed as being "different" interrupts. It is within the scope of 
the present invention that multiple interrupts generated upon receipt of a plurality of 
packets may be asserted at different pins. 

[0026] The function of the packet timer 84 is to minimize latency during periods of 
low packet ingress at network interface 80. The packet timer 84 has a threshold that will 
be referred to herein as the "first" threshold. Generally, the first threshold corresponds to 
a time period that is greater than a minimum inter-frame gap (IFG) but that is less than 
the sum of the minimum IFG and a packet time; however, it should be understood that 
the first threshold may correspond to any other suitable time period. The IFG is the time 
differential between incoming packets and the minimum, allowable IFG is generally a 
known value that is a function of the network architecture and/or other characteristics of 
the system 1 and/or network 5. The packet time may correspond to, for example, the 
time necessary for receipt of a packet or the time necessary to determine the destination 
address of a packet. All packets arriving at network interface 80 may not exhibit the 
same characteristics - e.g., all packets may not be of identical byte length - and, 
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therefore, each incoming packet may have a unique packet time. Accordingly, an 
average expected packet time may be used in determining the first threshold. 
[0027] The function of the absolute timer 86 and the absolute counters 88a, 88b, 
respectively, is to minimize latency during periods of high packet ingress at network 
interface 80. Each of the absolute timer 86, absolute packet counter 88a, and absolute 
byte counter 88b has a threshold - which will be referred to herein as the "second" 
threshold - that generally corresponds to a maximum latency or to a selected number of 
packets that are to be received during high traffic periods before assertion of the packet 
ingress interrupt. The selected number of packets may be a function of available memory 
resources in the system 1 and/or network interface 80. For the absolute timer 86, the 
second threshold corresponds to the maximum latency or to a pre-determined time period 
in which the selected number of packets may be received. For the absolute packet 
counter 88a, the second threshold may correspond to the selected number of packets and, 
for the absolute byte counter 88b, the second threshold represents a total number of bytes 
that may be present in the selected number of packets. As noted above, incoming packets 
at network interface 80 may exhibit varying characteristics. For example, incoming 
packets may have different byte lengths and/or may be separated in time by varying 
IFGs. Accordingly, the second threshold may be based on average characteristics of 
incoming packets. For example, the second threshold for the absolute timer 86 may be 
based on a multiple of the average expected packet time or based on a multiple of the 
sum of an average IFG and the average expected packet time. Similarly, the second 
threshold for the absolute byte counter 88b may be based on an average expected packet 
length. 

[0028] A method 400 of moderating packet ingress interrupts, as may be 
implemented in a network interface 80 having a packet timer 84 and an absolute timer 86 
(see FIG. 1), is illustrated in FIG. 4. As noted above, the packet timer 84 is set to, or 
exhibits, a first threshold, and the absolute timer 86 is set to, or exhibits, a second 
threshold. Referring to reference numeral 405, if a packet is received, the packet timer 84 
is started (or restarted), as denoted at 410. When started, the packet timer 84 will count 
downwards in time from the first threshold. It is then determined whether the absolute 
timer 86 has been started - see reference numeral 415 - and, if the absolute timer 86 has 
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not been started, the absolute timer 86 is started, as shown at 420. The absolute timer 86 
will then count downwards in time from the second threshold. 

[0029] Referring to reference numeral 425, when either one of the packet timer 84 
and absolute timer 86 expires, the packet timer 84 is reset to the first threshold and the 
absolute timer 86 is reset to the second threshold, both as denoted by reference numeral 
430. In addition, as shown at 435, the packet ingress interrupt is asserted upon expiration 
of either one of the packet and absolute timers 84, 86. The next packet received at 
network interface 80 will again start the packet timer 84 (see reference numeral 410) and 
the absolute timer 86 (see reference numeral 420). If neither of the timers 84, 86 has 
expired (see reference numeral 425), the network interface 80 will continue to monitor 
for incoming packets (see reference numeral 405) and any subsequently received packet 
will restart the packet timer 84 (see reference numeral 410). 

[0030] If the packet timer 84 has expired, which may occur during a period of low 
packet ingress, the packet ingress interrupt will indicate receipt of the packet that 
triggered the packet timer 84, as well as receipt of any packet received subsequent to the 
most recent assertion of the packet ingress interrupt. For example, a packet may be 
received and, if no other packet is received prior to expiration of the packet timer (i.e., 
during the time period defined by the first threshold), the packet ingress interrupt will be 
asserted to indicate receipt of that packet. In a further example, a plurality packets are 
received at network interface 80, wherein each of the plurality of packets causes the 
packet timer 84 to restart, as noted above; however, the time period in which these 
packets are received is less than that defined by the second threshold. After the last of the 
plurality of packets is received, no other packet is received prior to expiration of the 
packet timer 84 (the absolute timer 86 having not yet expired). The packet ingress 
interrupt is then asserted and, in this instance, the packet ingress interrupt indicates 
receipt of each of the plurality of packets. Accordingly, during low traffic periods, the 
network interface 80 will not "wait" for additional packets to be received and assertion of 
the packet ingress interrupt will not be unduly delayed and packet latency is minimized. 
[0031] If the absolute timer 86 has expired, such as may occur during periods of high 
packet ingress, the packet ingress interrupt will indicate receipt of the initial packet - i.e., 
the packet that triggered the absolute timer 86 - and all other packets received prior to 
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expiration of the absolute timer 86 - i.e., those packet received during the period defined 
by the second threshold. Thus, in high traffic periods, assertion of the packet ingress 
interrupt will indicate receipt of multiple packets and, because interrupt processing will 
not take place for every packet received, the load on processor 20 will be reduced and 
latency minimized. 

[0032] Every packet received at the network interface 80 will cause the packet timer 
84 to restart, as shown at reference numerals 405 and 410. So long as packets continue to 
arrive at the network interface 80 - each of the packets being separated in time from the 
preceding packet by a time period (IFG) that, in combination with the packet time, is less 
than the first threshold - the packet timer 84 will repeatedly be restarted and will not 
expire (although the absolute timer 86 may expire). Thus, during periods of high packet 
ingress, the packet ingress interrupt will not be asserted until the absolute timer 86 has 
expired, thereby allowing a single assertion of the packet ingress interrupt to indicate 
receipt of a large number of packets. 

[0033] The method 400 of moderating packet ingress interrupts may be further 
understood by reference to the timing diagrams shown in FIGS. 5 and 6. The timing 
diagram of FIG. 5 illustrates operation of the network interface 80, as may occur during 
periods of low packet ingress, and the timing diagram of FIG. 6 illustrates operation of 
the network interface 80, as may occur during periods of high packet ingress. 
[0034] Referring to FIG. 5, a graph 510 shows receipt of packets (axis 5 12) as a 
function of time (axis 505), a graph 520 shows the state of the packet timer 84 (axis 522) 
as a function of time (axis 505), and a graph 530 shows the state of the absolute timer 86 
(axis 532) as a function of time (axis 505). A first packet 515a is received (see graph 
5 10) at network interface 80, causing the packet timer 84 to start and count downwards in 
time from the first threshold 151. Also, the absolute timer 86 is started in response to 
receipt of the first packet 515a, the absolute timer 86 counting downwards in time from 
the second threshold 152. 

[0035] Later in time, a second packet 5 15b is received at the network interface 80. 
The sum of the IFG 517b between the first and second packets 515a, 515b and the packet 
time 518b of second packet 515b is less than the first threshold 151 - stated another way, 
when second packet 515b has been received, the packet timer 84 has not yet expired - 
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causing the packet timer 84 to reset to the first threshold 151 and restart. A curve 525a 
depicts the state of the packet timer 84 after receipt of the first packet 515a, whereas 
another curve 525b depicts the state of the packet timer 84 after receipt of the second 
packet 515b. The absolute timer 86 continues to count downwards in time and is 
unaffected by receipt of the second packet 515b (a curve 535' depicts the state of the 
absolute timer 86 after receipt of the first packet 5 1 5a). 

[0036] Each of the packet timer 84 (see curve 525b) and absolute timer 86 (see curve 
535') continues counting down in time. No subsequent packet is received during the time 
period defined by the first threshold 151, and the packet timer 84 expires. In response to 
expiration of packet timer 84, the packet ingress interrupt is asserted, as denoted by arrow 
201, and the packet ingress interrupt will indicate receipt of the first and second packets 
525a-b. At the time of expiration of the packet timer 84, the absolute timer 86 had not 
yet expired. Upon expiration of the packet timer 84, each of the packet timer 84 and the 
absolute timer 86 is reset, the packet timer 84 being reset to the first threshold 151 and 
the absolute timer being reset to the second threshold 152. 
[0037] At some later point in time, a third packet 5 1 5c is received at network 
interface 80. The sum of the IFG 5 1 7c between the second and third packets 5 1 5b, 5 1 5c 
and the packet time 5 1 8c of the third packet 5 1 5c is greater than the first threshold 1 5 1 
(causing the packet timer 84 to expire after receipt of the second packet 515b, as noted 
above). In response to receipt of the third packet 515c, the packet timer 84 is restarted - 
the packet counter 84 counting downward in time from the first threshold 151 - and the 
absolute timer 86 is again started - the absolute timer 86 counting downward in time 
from the second threshold 1 52. A curve 525c depicts the state of the packet timer 84 
after receipt of the third packet 5 15c, and a curve 535" depicts the state of the absolute 
timer 86 after receipt of the third packet 5 15c. 

[0038] Referring now to FIG. 6, a graph 610 shows receipt of packets (axis 612) as a 
function of time (axis 605), a graph 620 shows the state of the packet timer 84 (axis 622) 
as a function of time (axis 605), and a graph 630 shows the state of the absolute timer 86 
(axis 632) as a function of time (axis 605). A first packet 615a is received (see graph 
610) at network interface 80, causing the packet timer 84 to start and count downwards in 
time from the first threshold 151. Also, the absolute timer 86 is started in response to 
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receipt of the first packet 615a, the absolute timer 86 counting downwards in time from 
the second threshold 152. 

[0039] A second packet 615b is subsequently received at network interface 80, the 
second packet 615b being separated in time from the first packet by an IFG 617b and 
having a packet time 618b. The sum of the IFG 617b and packet time 618b for the 
second packet 615b is less than the first threshold 151 and, therefore, the packet timer 84 
does not expire prior to receipt of the second packet 61 5b. Accordingly, the packet timer 
84 resets to the first threshold 151 and restarts in response to receipt of the second packet 
615b. A curve 625a depicts the state of the packet timer 84 after receipt of the first 
packet 615a, and a curve 625b depicts the state of the packet timer 84 after receipt of the 
second packet 615b. 

[0040] Later in time, a third packet 61 5c is received at the network interface 80. The 
third packet 615c is separated in time from the second packet 615b by an IFG 617c, and 
the third packet 615c has a packet time 618c. The sum of the IFG 617c and packet time 
618c associated with the third packet 615c is less than the first threshold 151, and the 
packet timer 84 will, therefore, not expire prior to receipt of the third packet 615c. Thus, 
in response to receipt of the third packet 61 5c, the packet timer 84 resets and restarts. A 
curve 625c depicts the state of the packet timer 84 after receipt of the third packet 61 5c. 
[0041] The absolute timer 86 is unaffected by receipt of the first, second, and third 
packets 615a-c; it simply counts downward in time from the second threshold 152. The 
successive arrival of the first, second, and third packets 615a-c has prevented the packet 
timer from expiring (i.e., the packet timer 84 has been reset and restarted in response to 
arrival of the second and third packets 615b, 615c, respectively) and, at some point in 
time after receipt of the third packet 615c, the absolute timer 86 expires (i.e., a time 
period corresponding to the second threshold 152 has passed). A curve 635 depicts the 
state of the absolute timer 86 after receipt of the first packet 61 5a. Upon expiration of the 
absolute timer, the packet ingress interrupt is asserted, as denoted by arrow 201, and the 
packet ingress interrupt will indicate receipt of the first, second, and third packets 615a-c. 
Also, in response to expiration of the absolute timer 86, the packet timer 84 is reset to the 
first threshold 151 and the absolute timer 86 is reset to the second threshold 152. 
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[0042] A fourth packet 61 5d is subsequently received at the network interface 80. 
The fourth packet is separated in time from the third packet 61 5c by an IFG 617d and has 
a packet time 618d. The sum of the IFG 617d and packet time 61 8d of the fourth packet 
61 5d is less than the first threshold 151; however, the packet timer 84 has already been 
reset to the first threshold 151 after expiration of the absolute timer 86. Receipt of the 
fourth packet 61 5d will simply restart the packet timer 84 and restart the absolute timer 
86, the packet and absolute timers 84, 86 again counting downwards in time from the first 
and second thresholds 151, 152, respectively. 

[0043] In the text set forth above with respect to FIGS. 1 through 6, the packet timer 
84 has been described as counting downwards in time from the first threshold (i.e., from 
the first threshold to zero, unless the packet timer 84 is reset prior to expiration). 
Similarly, the absolute timer 86 has been described as counting downwards in time from 
the second threshold (i.e., from the second threshold to zero, unless reset prior to 
expiration). It should be understood, however, that the packet timer 84 may count 
upwards in time - i.e., from zero to the first threshold, unless reset prior to expiration - 
and, further, that the absolute timer 86 may count upwards in time - i.e., from zero to the 
second threshold, unless reset prior to expiration. Thus, use of the terms "expiration", 
"expired", and "expires" with respect to the first threshold refer herein to the passage of a 
period of time equivalent to the first threshold, irrespective of whether the packet timer 
84 is counting upwards in time or downwards in time. Similarly, use of these terms 
("expiration"; "expired"; "expires") with respect to the second threshold refer herein to 
the passage of a period of time equivalent to the second threshold, irrespective of whether 
the absolute timer 86 is counting upwards or downwards in time. Further, although 
FIGS. 5 and 6 depict the timers 84, 86 as starting (or restarting) at completion of the 
ingress operation of a packet from the network 5 to network interface 80, it should be 
understood that the timers 84, 86 (as well as the absolute packet and byte counters 88a, 
88b) may be triggered at the beginning of a packet ingress operation or after some portion 
of the ingress operation has been completed. 

[0044] Illustrated in FIG. 7 is a method 700 of moderating packet ingress interrupts, 
as may be implemented in a network interface 80 including a packet timer 84 and an 
absolute counter, such as, for example, an absolute packet counter 88a (see FIG. 2) or an 
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absolute byte counter 88b (see FIG. 3). Again, the packet timer 84 has a first threshold 
and the counter would have a second threshold. For an absolute packet counter 88a, the 
second threshold corresponds to a selected number of packets (which may be determined 
based on average packet characteristics, as noted above) that are to be received during 
periods of high traffic before assertion of the packet ingress interrupt. For an absolute 
byte counter 88b, the second threshold is a number of bytes corresponding to the selected 
number of packets (which may be determined based on an averaged expected byte length, 
as noted above). 

[0045] When a packet is received, as denoted by reference numeral 705, the packet 
timer 84 is started (see reference numeral 710). The packet timer 84 will count 
downwards (or upwards) in time from (or to) the first threshold. Referring to reference 
numeral 71 5, it is also determined whether the absolute counter - either a packet counter 
88a or a byte counter 88b - has been started and, if the absolute counter has not been 
started, the absolute counter is started, as shown at 720. Beginning from the second 
threshold, the absolute counter will be decremented by a number of received packets (for 
a packet counter 88a) or by a number of received bytes (for a byte counter 88b). 
Alternatively, starting from zero, the absolute counter may increment upwards to the 
second threshold, either by a number of received packets or a number of received bytes, 
as noted above. 

[0046] Referring to reference numeral 725, if the packet timer 84 expires, the packet 
timer 84 is reset to the first threshold and the absolute counter 88a, 88b is reset to the 
second threshold, both as shown at 740. Further, the packet ingress interrupt is asserted 
in response to expiration of the packet timer 84, as denoted by reference numeral 745. 
The packet ingress interrupt will, in this instance, indicate receipt of the packet that 
triggered the packet timer 84 and will also indicate receipt of any packet received 
subsequent to the most recent assertion of the packet ingress interrupt (see FIG. 5 and 
accompanying text). The next packet received at network interface 80 will restart the 
packet timer 84 (see reference numeral 710) and the absolute counter 88a, 88b (see 
reference numeral 720). 

[0047] Referring to reference numeral 730, if the absolute counter 88a, 88b expires, 
each of the packet timer 84 and absolute counter 88a, 88b is reset - the packet timer reset 
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to the first threshold and the absolute counter 88a, 88b reset to the second threshold - as 
shown at reference numeral 740. In addition, as denoted at 745 , the packet ingress 
interrupt is asserted upon expiration of the absolute counter 88a, 88b. The packet ingress 
interrupt will indicate receipt of the packet that triggered the absolute counter 88a, 88b, as 
well as all other packets received prior to expiration of the absolute counter 88a, 88b. 
Once again, the next packet received at network interface 80 will restart the packet timer 
84 (see reference numeral 710) and the absolute counter 88a, 88b (see reference numeral 
720). 

[0048] If neither of the packet timer 84 and absolute counter 88a, 88b has expired 
(see reference numerals 725, 730), the network interface 80 will continue monitoring for 
incoming packets (see reference numeral 705) and any subsequently received packet will 
restart the packet timer 84 (see reference numeral 710). Also, if the packet timer 84 has 
not expired and, further, if the absolute counter 88a, 88b has not expired, the absolute 
counter is decremented, as shown at 735. An absolute packet counter 88a would be 
decremented (or incremented) by the packet received at network interface 80 - i.e., by 
one - whereas an absolute byte counter would be decremented (or incremented) by a 
number of bytes received at network interface 80. 

[0049] Both of FIGS. 5 and 6, as well as the accompanying text, are generally 
applicable to the method 700 of packet ingress interrupt moderation shown and described 
with respect to FIG. 7. Accordingly, each of FIGS. 5 and 6 and the accompanying text 
are generally applicable to the method 700 shown in FIG. 7. However, rather than 
counting downwards (or upwards) in time using an absolute timer, an absolute packet 
counter 88a will be decremented (or incremented) by received packets and an absolute 
byte counter 88b will be decremented (or incremented) by a number of received bytes. 
For the packet counter 88a, use of the terms "expiration", "expired", and "expires" with 
respect to the second threshold refer herein to reception of the selected number of 
packets, irrespective of whether the absolute packet counter 88a is decrementing 
downwards or incrementing upwards. Similarly, for the byte counter 88b, use of the 
terms "expiration", "expired", and "expires" with respect to the second threshold refer 
herein to reception of the appropriate number of bytes, irrespective of whether the 
absolute byte counter 88b is decrementing downwards or incrementing upwards. 
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[0050] Yet a further embodiment of a method 800 of packet ingress interrupt 
moderation is illustrated in FIG. 8. The method 800 is similar to the method 400 of 
packet ingress interrupt moderation shown and described with respect to FIG. 4, and ' 
those actions illustrated in FIG. 8 that are identical to an action in FIG. 4 have retained 
the same reference numeral. Further, although the method 800 is shown and described in 
the context of a network interface 80 having a packet timer 84 and an absolute timer 86, it 
should be understood that the method 800 is equally applicable to a network interface 
having either one of an absolute packet counter 88a and an absolute byte counter 88b. 
[0051] Referring to FIG. 8, if a packet has passed filtering at network interface 80, as 
denoted at reference numeral 805, the packet timer (if previously started) is stopped, as 
shown at 806. Filtering is, by way of example, a process of determining whether to 
accept - e.g., does the packet have the correct address? - an incoming packet. The 
network interface 80 finishes receiving the packet - see reference numeral 807 - and the 
packet timer 84 is then started, as denoted at 410. The remaining portions (i.e., reference 
numerals 415, 420, 425, 430, 435) of the method 800 of FIG. 8 are identical to their 
respective counterparts in the method 400 shown and described with respect to FIG. 4. 
By stopping the packet timer 84 when a packet passes filtering and, subsequently, 
restarting the packet timer 84 after receipt of that packet is complete, variations in packet 
length are eliminated and the packet timer 84 is concerned only with the inter-frame gap 
between successive incoming packets. 

[0052] The method 800 of packet ingress interrupt moderation may be better 
understood by reference to the timing diagram of FIG. 9. With reference to FIG. 9, a 
graph 910 shows receipt of packets (axis 912) as a function of time (axis 905), a graph 
920 shows the state of the packet timer 84 (axis 522) as a function of time (axis 905), and 
a graph 930 shows the state of the absolute timer 86 (axis 932) as a function of time (axis 
905). A first packet 915a is received (see graph 910) at network interface 80, causing the 
packet timer 84 to start and count downwards (or upwards) in time from the first 
threshold 151. Also, the absolute timer 86 is started in response to receipt of the first 
packet 915a, and the absolute timer 86 counts downwards (or upwards) in time from the 
second threshold 152. 
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[0053] At some point later in time, a second packet 915b arrives at the network 
interface 80 and, when that packet 915b passes filtering (as denoted at 950b), the packet 
timer 84 is stopped. The IFG 917b between the first and second packets 915a, 915b (plus 
filtering time) is less than the first threshold and, therefore, the packet timer 84 has not 
yet expired when the packet 915b passed filtering. When receipt of the second packet 
915b is complete (as denoted at 960b), the packet timer 84 is reset to the first threshold 
and restarted. A curve 925a depicts the state of the packet timer 84 after receipt of the 
first packet 915a, and a curve 925b depicts the state of the packet timer 84 after receipt of 
the second packet 915b. The absolute timer 86 continues to count downwards in time 
and is unaffected by receipt of the second packet 915b. A curve 935' depicts the state of 
the absolute timer after receipt of the first packet 915a. 

[0054] Subsequently, a third packet 915c arrives at the network interface 80 and 
passes filtering (as denoted by reference numeral 950c). However, the IFG 917c between 
the second packet 915b and the third packet 915c (plus filtering time) is greater than the 
first threshold 151; thus, the packet timer 84 has expired prior to arrival of the third 
packet 915c. Upon expiration of the packet timer 84, the packet ingress interrupt is 
asserted, as denoted by arrow 201 . The packet ingress interrupt will indicate receipt of 
the first and second packets 915a, 915b. Also, in response to expiration of the packet 
timer 84, each of the packet timer 84 and absolute timer 86 is reset to the first and second 
thresholds 151, 152, respectively. When receipt of the third packet 915c is complete (as 
denoted at 960c), each of the packet timer 84 and absolute timer 86 will restart. A curve 
925c depicts the state of the packet timer 84 after receipt of the third packet 915c, 
whereas a curve 935" depicts the state of the absolute timer 86 after receipt of the third 
packet 915c. 

[0055] Embodiments of a method 400, 700, 800 for packet ingress interrupt 
moderation - as well as embodiments of a network interface 80 - having been herein 
described, those of ordinary skill in the art will appreciate the advantages thereof. Using 
a packet counter 84 in conjunction with one of an absolute timer 86, an absolute packet 
counter 88a, and an absolute byte counter 88b, the load on processor 20 is reduced and 
packet latency minimized during periods of high packet ingress at network interface 80, 
while also minimizing packet latency during periods of low traffic. However, no 
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algorithms for predicting future packet ingress rates are necessary. Also, as illustrated by 
the method 800 of packet ingress interrupt moderation, interrupt moderation can be based 
primarily on the inter-frame gap between successive packets and variations in packet 
length can be substantially eliminated. 

[0056] The foregoing detailed description and accompanying drawings are only 
illustrative and not restrictive. They have been provided primarily for a clear and 
comprehensive understanding of the present invention and no unnecessary limitations are 
to be understood therefrom. Numerous additions, deletions, and modifications to the 
embodiments described herein, as well as alternative arrangements, may be devised by 
those skilled in the art without departing from the spirit of the present invention and the 
scope of the appended claims. 
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